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MATHEMATICAL ANALYSIS FOR THE ESTIMATION OF 
CHANGES IN THE LEVEL OF GENE EXPRESSION 

Field of the Invention 

The present invention relates to a mathematical analysis for the quantitative estimation 
of the level of differential gene expression. More specifically, the present invention relates to 
the mathematical derivation of an a posteriori distribution of all the fold-changes of the level 
of gene expression which may be inferred from the given experimental measurements. 

Background of the Invention 

Cells rely upon their numerous protein components for a wide variety of functions. 
These functions include, e.g., the production of energy, the biosynthesis of all component 
macromolecules, the maintenance of cellular architecture, the ability to act upon intra- and 
extracellular stimuli, and the like. Each cell within an organism in contains the information 
necessary to produce the repertoire of proteins that organism can expressed. This information 
is stored as genes within the organism's genome. The number of unique human genes is 
estimated to be 30,000 to 100,000. 

For any given cell, only a portion of the gene set is expressed in the form of protein. 
Some of the proteins are likely to be present in all cells {i.e., are ubiquitously expressed) 
because they serve biological fiinction(s) which are required in every type of cell, and can be 
thought of as "housekeeping" proteins. In contrast, other proteins serve specialized functions 
that are only required in particular cell types. For example, muscle cells contain specialized 
proteins that form the dense contractile fibers of a muscle. Given that a large part of a cell's 
specific functionality is determined by the genes it is expressing, it is logical that transcription, 
the first step in the process of converting the genetic information stored in an organism's 
genome into protein, would be highly regulated by the control network that coordinates and 
directs cellular activity. 

Regulation of gene expression is readily observed in studies that examine activities 
evident in cells configuring themselves for a particular function (e.g., specialization into a 
muscle cell) or state (e.g., active multiplication or quiescence). Hence, as cells alter their 
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status, the coordinated transcription of the protein(s) which are requited for this molecular 
biological/physiological "state" can be observed. This highly detailed, global knowledge of 
the cell's transcriptional state provides information on the cell's status, as well as on the 
biological system(s) controlling this status. For example, knowledge of when and in what 
types of cell the protein product of a gene of unknown function is expressed would provide 
useful clues as to the likely function of that gene. Determination of gene expression patterns 
in normal cells could provide detailed knowledge of the way in which the control system 
achieves the highly coordinated activation and deactivation required for development and 
differentiation of a mature organism from a single fertilized egg. Comparison of gene 
expression patterns in normal and pathological cells could provide useful diagnostic 
"fingerprints" and help identify aberrant functions that would be reasonable targets for 
therapeutic intervention. 

Unfortunately, the ability to carry out studies in which the transcriptional state of a 
large number of genes is determined has, until recently, been inhibited by limitations on the 
ability to survey cells for the presence and abundance of a large number of gene transcripts in a 
single experiment. One limitation can be in the small number of identified genes. In the case 
of humans, only a few thousand proteins encoded within the human genome have been 
physically purified and quantitatively characterized to any extent. Another limitation can be in 
the manner of transcription analysis. 

Two recent technological advances address have aided analyses of gene transcription. 
The cloning of molecules derived from mRNA transcripts in particular tissues, followed by the 
application of high-throughput sequencing to the DNA ends of the members of these libraries 
has yielded a catalog of expressed sequence tags (ESTs). See e.g., Boguski and Schuler, Nat. 
Genetics 10: 369-370 (1995). These "signature sequences" can provide unambiguous 
identifiers for a large cohort of genes. 

In addition, the clones from which these sequences were derived provide analytical 
reagents that can be used in the quantitation of transcripts front biological samples. The 
nucleic acid polymers, DNA and RNA, are biologically synthesized in a copying reaction in 
which one polymer serves as a template for the synthesis of an opposing strand, which is 
termed its complement. Following the separation of the strands from one another (i.e., 
denaturation), these strands can be induced to pair, quite specifically, with other nucleic acid 
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strands possessing a complementary sequence in a process called hybridization. This specific 
binding can be the basis of analytical procedures for measuring the amount of a particular 
species of nucleic acid, such as the mRNA specifying a particular protein gene product. 

A second advance involves microarray/microassay technology. This is a 
hybridization-based process which allows simultaneous quantitation of many nucleic acid 
species. See e.g., DeRisi et al., Nat. Genetics 14: 457-460 (1996); Schena et aL, Proc. Natl. 
Acad. Sci. USA 93: 10614-10619 (1996). This technique combines robotic placement (i.e., 
spotting) of small amounts of individual, pure nucleic acid species on a glass surface, 
hybridization to this array with multiple fluorescently-labeled nucleic acids, and detection and 
quantitation of the resulting fluorescent-labeled hybrids with, for example, a scanning confocal 
microscope. When used to detect transcripts, a particular RNA transcript (i.e., an mRNA) can 
be copied into DNA (i.e., a cDNA) and this copied form of the transcript is subsequently 
immobilized onto, for example, a glass surface. 

A problem in the analysis of gene expression data is the estimation of the overall fold- 
change in the expression level of a gene in one experiment relative to its expression in another 
experiment. Given these two raw measurements of the fold-change in gene expression level, 
the simplest approach, as utilized by previous methodologies, has been to take the arithmetic 
ratio of the values as an estimate of the overall fold-change. While for very strong signals this 
leads to a meaningful estimate of the fold-change in the underlying mRNA concentrations, for 
weaker signals the results are much more ambiguous because of contamination by the "noise" 
which is indigenous to the particular experimental system utilized. Another previously utilized 
technology for the estimation of the fold-change in gene expression level is based upon 
differential-signal intensities (e.g., the Affymetrix® chip). However, the values assigned to 
expression levels by use of the aforementioned methodology can be negative, thus leading to 
the awkward situation of negative or undefined gene expression ratios. 

Summary of the Invention 

The present invention provides a highly accurate and reproducible mathematically- 
based methodology for quantifying the levels of differential gene expression from microassay 
protocols. 



3 



WO 00/71756 PCT/US00/14674 

The methods of the present invention can be used to calculate differences in the level 
of gene expression in one or more aiTays of genes. The methods involve defining the 
experimental noise associated with intensity of hybridization signal for each gene in the 
array(s). The experimental noise is variations in observed levels on chips or other microarrays 
rather than biological noise, which is the variation of expression level seen in biological 
systems. Detection of genes is often, but not always, based on fluorescence. Other detection 
systems have been used which may be adapted here. Such systems include luminescent or 
radioactive labels, biotinylated, haptenated, or other chemical tags that allow for easy detection 
of labeled probes. 

For a mathematical description, see Section I - Formulation of the Noise Model below. 
The noise is assumed to be Gaussian and Bayes Theorem is applied. The defined experimental 
noise term, sigma, is then used to define an analytical (i.e., analytical in the mathematical 
sense meaning that it is a continuous function) probability distribution function ("pdf ') 
describing distribution values of intensity for each gene. These pdfs are used to derive an 
analytical joint pdf describing possible ratios or fold changes for any differentially-expressed 
gene or gene product in the array(s). The joint pdfs are applied using experimentally-derived 
intensities and noise values from the genes on the array(s) (1) to estimate fold changes in the 
concentration of gene transcripts, (2) to use the jpdf to establish the confidence limits on the 
fold change given specific confidence intervals, and (3) to derive a /rvalue, or quality metric 
(the probability a fold change could be less than 1, when the estimate is greater than 1, or, the 
probability that the fold change is greater than 1, when the estimate is less than 1), associated 
with the fold change estimate. The estimated fold change determined by the methods of the 
present invention represents the difference in level of gene expression observed. The total 
variance (i.e., noise) may still be high even as the concentration of transcript goes to zero. The 
methods of the present invention use a mathematical formula to describe an a posteriori 
statistical distribution of all the levels of gene expression which may be derived from the 
measurements obtained of levels of gene expression in one or more cells or tissue types 
represented in the array(s). 

Microarrays are an ordered array of double stranded or single stranded DNA molecules 
positioned on a support material in a spatially separated organization. In contrast to filter 
"macroarrays", which are typically large sheets of nitrocellulose, microarrays position the 
DNA more densely packed organization such that up to 1 0000 DNA molecules can be fit into 
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a region typically 1-4 square centimeters. Microarrays typically use coated glass as the solid 
support, in contrast to the nitrocellulose-based material of filter arrays. By having an ordered 
array of DNA samples, the position of each sample can be tracked and linked to the original 
sample from which the DNA on the array was generated. Methods and apparatus for preparing 
a microarray have been described. See, e.g., United States Patents 5,445,934 and 5,800,992, 
both incorporated herein by reference. 

The DNA samples on the microarray are hybridized with RNA or DNA probes that 
have been fluorescently labeled to identify whether the probe sample contains a molecule that 
is similar or identical to the DNA sample on the microarray. Under the appropriate conditions, 
probe molecules hybridize to a DNA molecule on the microarray. Generally, identical or near 
identical sequences form productive hybrids. The presence of DNA-probe hybrid molecules is 
detected by a fluorescence detection instrument. If the hybridization signal is weak or non- 
existent at a particular DNA site, then the corresponding DNA or RNA molecule in the probe 
is absent. Current microarray instruments can hybridize up to four different fluorescent probe 
samples at one time. With improvements to the technology, more probes can be hybridized at 
once. 

Up until recently, DNA hybridizations were performed on nitrocellulose filters. In 
contrast to microarrays where DNA is spotted directly onto the microarray, filter arrays are 
generated by spotting bacterial colonies on the filters, placing the filters over a agar growth 
media, and incubating the filters under conditions that promote the bacterial colonies to grow. 
The DNA within the bacterial colonies is released by lysing the colony and treating the filters 
to fix the DNA to the filter material. The process of generating a bacterial filter array can take 
typically 2-4 days. Microarrays have a number of advantages over filter array methods. For 
example, filter methods generally array bacterial colonies in which the cloned cDNA is 
contained. The colonies must be grown up over several days, lysed to release DNA and fix 
DNA onto the filter. Hybridization to filter arrays of colonies is less reliable due to bacterial 
debris and the low amount of DNA released from the colony. A second advantage is that the 
iterations are quicker with microarrays than with filters. This is due to the time needed to 
grow colonies on the filters and prepare them for the next round of hybridization. In contrast, 
probing of a subsequent microarray can begin less than 24 hr after analysis of an array is 
completed. Another advantage of microarrays is the ability to use fluorescently labeled 
probes. This provides for a non-radioactive method for hybridization detection. In contrast, 
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filter hybridization generally uses probes labeled with radioactive phosphorus or sulfur. 
Microarrays can be hybridized with multiple probes simultaneously. In contrast, filter arrays 
can only be hybridized with one probe at a time. One of the most important advantages of 
microarrays is their reproducibility and sensitivity of hybridization signals. Typically, 
hybridization signals are higher and sensitivity is greater on microarrays versus filter arrays. 
In addition, filter arrays often exhibit spurious background signals that are unrelated to 
productive hybridization between the probe and DNA on the filter. 

Once the random sample of nucleic acid fragments is immobilized to a solid surface 
(e.g., glass) in a microarray, the random sample of nucleic acid fragments can then be 
hybridized to one or more labeled probes complementary to genes or sequences of interest. 
Generally, the unhybridized probes are removed. The labeled probes are then detected by 
methods known in the art (e.g., confocal microscopy). For example, slide images can be 
analyzed with Array Vision image analysis software (Imaging Research) for spot finding 
analysis, localized background determination, distribution of signal intensities in a spot, and 
signal to noise ratios. Statistical assessment is then performed as described below. 

The present invention utilizes a mathematically-based methodology to quantitative the 
fold-change in the levels of differentially expressed genes. Specifically, the present invention 
uses a simple deductive approach, grounded in a Bayesian framework, to circumvent the 
heuristic-based limitation of previous methodologies used in the mathematical analysis of 
differential gene expression. The present invention, rather than immediately seeking a point- 
estimate of the fold-change of the level of gene expression, derives a mathematical formula for 
the a posteriori distribution of all the fold-changes of differential gene expression which may 
be inferred from the given measurements. From this a posteriori distribution the following 
information may be obtained: (i) an estimator for the fold-change of the level of gene 
expression; (11) confidence limits for the fold-change, at any given confidence level; and (Hi) a 
P-value for assessing the statistical significance of change. An additional advantage of the 
present invention is that fold-change estimates and confidence limits may even be assigned to 
signal pairs where both signals are zero or negative, without resorting to heuristic thresholds. 
Hence, the mathematical framework disclosed herein unifies estimation for all signals within a 
given sample. 



6 



WO 00/71756 PCT7US00/14674 

Brief Description of the Drawings 

FIG. 1 is a line graph illustrating an a posteriori distribution of the fold change, 
Equation (16), for a series of measurement pairs (jc 15 x 2 ). In all cases but (0, 0), the ratio of 
measurements is 4. The standard deviation of both noise terms is kept constant at = ct 2 = 
20. 

FIG. 2 is a qualitative illustration of the derivation of Equation(16), explaining the 
behavior of the distributions shown in FIG. 1 . For each pair of signals (*„ jc 2 ), a box is drawn 
with extents ± ar c about a point in the plane. Lines are drawn from the origin to the point in the 
box: the distribution of slopes of these lines is the a posteriori distribution of fold-changes. 
Panel A represents construction for signals (100, 400). Panel B represents construction for 
signals (5, 20). 

FIG. 3 is a graphical mapping of intensities (x u x 2 ) into the (R, P) plane, as induced by 
Equations(30) and (33). Lines of constant x, and x 2 are shown. The dark line is the upper 
limit P U (R) of the range for P. 

FIG. 4 illustrates, in tabular form, the results of fold-change estimates R, 68% 
confidence intervals (Rp, R^), and P-values for significant positive fold-change, for all the 
measurement pairs of FIG. 1. 

FIG. 5 illustrates, in tabular form, the results of the performance of three statistical 
methodologies utilized for the detection of 1000 genes with actual fold-change of b = 3 against 
a background of 4000 genes with no change (fc = 1), based upon Monte Carlo simulations 
described in Section 6 herein (i.e., the a priori probability of a gene undergoing the 3-fold 
change is P x = 0.2). Specific results are reported for a fixed false positive rate P(0 1 p) = 0.3. 

FIG. 6 is a scatter of scatter plots in the (R, P) plane generated by: (1) 1000 genes from 
class 0, the no-change class (Panel A), and (2) 1000 genes from class 1 (Panel B). 

FIG. 7 is a line graph depicting a receiver operating characteristic (ROC) for the 
statistic t = P. 

FIG. 8 is a line graph depicting a receiver operating characteristic (ROC) for the 
statistic t = -P. 
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FIG. 9 is a line graph illustrating the compared sensitivity as a function of P l = fraction 
of genes which underwent a change (b = 3), for the R and P statistics. A fixed relative false 
positive rate P(0 1 p) = 0.3 is imposed throughout. 

FIG. 10 is a block diagram of a computer system for implementing features of the 
invention. 

FIG. 1 1 is a flow diagram of a process according to the invention. 

Detailed Description of the Invention 

Referring to FIG. 10, a computer system 102 includes a processor 104, memory 106, 
disk drives 108, a display 110, a keyboard 1 12, and a mouse 1 14. The processor 104 can be a 
personal computer central processing unit (CPU) such as a Pentium® III processor made by 
Intel® Corporation. Memory 106 includes random access memory (RAM) and read-only 
memory (ROM). The disk drives 108 include a hard-disk drive and can include floppy-disk 
drives, a CD-ROM drive, and/or a zip drive. The display 1 10 is a cathode-ray tube (CRT), 
although other forms of displays are acceptable, e.g., liquid-crystal displays (LCD) including 
TFT displays. The keyboard 1 12 and mouse 1 14 provide data input mechanisms for a user 
(not shown). The components 104, 106, 108, 1 10, 1 12, and 1 14 are connected by a bus 116. 
The computer system 102 can store, e.g., in memory 106, software code containing 
instructions for controlling the processor 102 to perform functions described below. 

1. Formulation of the Noise Model 

The measurements of the expression level of a given gene, in different or replicated 
experiments, is based upon x, which can be written: 

x = Cn + s (1) 

where n is the absolute physical concentration (molarity) of the mRNA of the gene in solution, 
where C is a proportionality constant linking molarity to recorded intensity, and where s is a 
noise term. In the following equations, the determination of the absolute mRNA concentration 
is not sought and thus, for simplicity, the following value is set C = 1 : 

x = n + € (2) 
In Equation (2) the noise term may be decomposed into three separate contributions: 
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S=€ b + £ e + S p , ( 3 ) 

where e b is a variation arising from fluctuations in background intensity, where e c is a term 
arising from cross-hybridization of other mRNAs (specific or non-specific), and where s p is a 
"proportionate variation" term, which arises from chip-to-chip variations in oligonucleotide or 
cDNA density, and other similar, factors. For example, with the Affymetrix® chips, where the 
final signal x is obtained from averaging over several differential signals, each of the noise 
terms can be positive or negative, with approximately zero average. Accordingly, the 
background and cross-hybridization terms may be grouped into a single noise term: 

e c= e 6 +e c (4) 
and the mean and variance of the total noise e are written as: 

<£>=0 



a] = var(* c ) + var(^) = cr 2 + {an) 2 



(5) 
(6) 



where a is the proportionate variation parameter, such that var(sp) =<r 2 = (an) 2 . The 
proportionate variation term a is similar to the coefficient of variation c (initially defined by 
Chen et aL, J. Biomed. Optics 2: 364 (1997)). Other noise terms intervene in this model as 
well, so that the total variance of the noise may remain large even as n 0. In the following 
equations it is assumed that 8 is normally distributed. 

Utilizing the Affymetrix® chips as an example, the combined background and cross- 
hybridization noise variance ct 2 are computed by taking the variance of the measurements x 
for all genes signaled as absent by the absence/presence decision algorithm. The proportionate 
term has been estimated by comparing the highest quartile of intensities in replication 
experiments. 

To illustrate the magnitude of the terms within Equation(6) for a typical Affymetrix® 
chip-based experiment the median value of the expression levels x is Med(*) « 80, with a c « 
25 and a « 0.25. Thus, the median signal over noise ratio Med(x)/a c is only approximately 3. 
The standard deviation of the background noise alone is a h « 3-4, so that a b « ct c with cross- 
hybridization noise dominating background noise by almost an order of magnitude. 
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Because the variable a c is relatively large, and a is small, Equation(6) can be slightly 
simplified by writing n^xon the right-hand side of the equation: 

a e 2 =a c 2 +(cxx) 2 , (7) 

so that the underlying concentration need not be known beforehand in order to quantitatively 
estimate the variance of the noise. 

2. A Posteriori Distribution of Concentrations 

While Equation(2) gives the measurement in terms of the concentration, the invention 
obtains the concentration as a function of the measurement. This may be formulated in 
probabilistic terms, by writing Bayes Theorem for the variable n and x: 



In Equation (8), P(x|n) is the conditional probability distribution function (pdf) for x, 
conditional on n, P(«) is the a priori distribution of n (thus, reflecting the state of knowledge 
of n prior to the measurement actually being taken), and P(x), the pdf for at, is essentially a 
normalization term. Hence, from Equation (2) and with the assumption of Gaussian noise, the 
following equation may be derived: 



P{x\n) = t 1 v , 2 exp(-(x - nf 1 2c 2 \ , 



(9) 



wherein a E = a c (/i), Equation (6). 



For the distribution P(«), as a priori knowledge, only the fact that the concentration is 
necessarily non-negative is utilized: 

JO n<0, 

^"tn-'i.- n>0, (10) 

where the limit u 0 very shortly (this is just an artifice to get a step-function distribution in 
the limit u -> 0, while keeping P(n) integrable at all times). Finally, P(x) is obtained by 
integration: 



P(x)= [dnP(n)P(x\n). (U) 
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With the limit ja 0, Equation (8) may be rewritten in the following manner: 
„, , P(x\n) 

where P(x\n) is given by Equation (9) and where the denominator is now: 

P(x)= [dn P(x\n) . (13) 

Equation (13) can be readily evaluated using error functions. Rather than directly explore the 
consequences of Equation (12) on estimation of concentrations, it will be utilized below to 
quantify the distribution of fold-changes. 

3. A Posteriori Distribution of Fold-Changes 

For a given gene, it may be assumed that one wishes to evaluate the fold-change in the 
level of gene expression between two given experiments (e.g., Experiments 1 and 2). For 
example, if the mRNA concentrations in the experiments are n x and n 2 , respectively, then the 
fold-change R of the concentration in Experiment 2 relative to Experiment 1, is given by: 



n 2 



* = ~T • 04) 



While in Equation (14), there is no direct access to n x and n 2J the estimation of R in Bayesian 
terms can be immediately formulated by writing the a posteriori distribution of R as: 

, (15) 

where and x 2 axe the intensity measurements in Experiments 1 and 2, respectively, where 
5(...) refers to the Dirac delta function, and where P(«|x) is given in Equation (12) above. 

Performing the integration indicated in Equation (15) is a very straightforward, if 
slightly tedious, task. The distribution function for R (i.e., dropping the explicit dependence 
on x x and x 2 in f R (R\x u x 2 )) is obtained by: 



C(x,)C(x 2 ) 



( ~2 



2kg x g 2 



AW = 'i: ex P - y\ i( X}9 x 2 ) , (i6) 



2(<j 2 2 + R 2 a; 
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where <y. 2 = a E 2 (x,.) , / - 1, 2, with a E (x) now given by Equation (7), with the normalization 
term: 

C(x) = — ^ r , (17) 

where erf is the error function (see Abramowitz, M. and Stegun, LA., p. 297 Handbook of 
Mathematical Functions (Dover, New York, 1972)), and with the definition: 

/ = a\ 2 exp(- ^-j + a 12 (2^ 2 2 ) 1/2 ±(l + erf(a n I V2cr 12 )) , (18) 

where: 



a n = 



( x. Rx 2 ^ 
— + — - 



_1 1 _2 

V<7 2 cr, y 



(20) 



Although rather complex-looking, Equation(16) possesses only two simple limits which will 
be discussed below through the utilization of two scenarios. 

3-1 Case 1 - High Concentrations: 

If in both experiments the RNA concentrations are large compared to the standard 
deviation of the noise, with consequence x ( »a E (x,), i = 1,2, R possess an approximately 
normal distribution: 

mk > w exp • <21) 

In this limit, the mean of R is just the ratio of the measurements: 

<R>=R, = ^ . (22) 
x, 

Hence, the variance a I ofR is given by: 
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, a 2 + x,cr, I x 2 



°i = ~* V— ^ • (23) 

Using Equation (7), in turn, a simple approximation for the standard deviation of R may be 
obtained: 

a R = yflaR^ . (24) 

Thus, in the high-concentration limit (i.e., Case 1) the standard deviation of actual fold-change 
relative to the ratio of the measurements is given by a constant: 

' (25) 

Upon examination, Equation (24) indicates that no matter how large the signal(s), there will 

remain an irreducible variation in fold-change estimation of order V2cT (« ±35% for a = 0.25) 
of the overall fold-change which is to be measured. 

3.2 Case 2 - Very Low Concentrations: 

If in both experiments the RNA concentrations are so low that x t « a e (x t ) 9 1= 1,2, then 
the distribution takes on the "universal" form of: 

• ''<*>" 7uTF ' (26 > 

where a x = a 2 is assumed for the sake of simplicity. 

In this limit, the distribution of R is completely independent of the concentrations, the 
influence of which has been overwhelmed by the noise. Equation(26) defines a so-called 
Cauchy distribution (see e.g., Keeping, E. S., Introduction to Statistical Inference, (Dover, 
New York, 1995)), which is very broad and does not have a finite mean. One indigenous 
"pathological" property of the Cauchy distribution is that the mean of many independent 
samples does not converge, in any sense, to a single number, but rather remains distributed 
according to Equation (26), regardless of the total number of samples utilized. Conversely, the 
median over the Cauchy distribution is exactly 1, and the sample median converges to 1, 
without any of the aforementioned pathologies associated with the median. 
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The cumulative distribution function of R is given by: 



p(r< p) = — tan" 1 /? 



(27) 



For example, the 90% confidence limits are (0.16, 6.3), showing that the distribution of 
Equation (26) is very broad, since these bounds will obtain even when R 0 = 1, provided that the 
signal is weak enough when compared to the noise. 

Finally, under the transformation \i = log R, the distribution function of Equation (26) 
becomes completely symmetrical: 



so that a logarithmic representation may be useful in some cases, although additional uses of 
the transformation shall not be pursued further herein. 

FIG. 1 displays the a posteriori distribution f R (R) for a series of pairs (jc„ x 2 ), for 
constant standard deviation of both noise terms a, — a 2 = 20. In this figure, the ratio x 2 lx x is 
always 4 (except for the case where both signals are 0), but the signal-to-noise ratio is highly 
variable. At the very highest signal levels, (jc„ x 2 ) = (100,400), and f R (R) is strongly peaked 
about R = 4. Even in this limit, however, visual inspection indicates that the 68% confidence 
interval (corresponding to a width of two standard deviations for a normal distribution) is 
roughly (3, 5). This shows that even when the lowest signal-to-noise ratio is 100/20 = 5, the 
actual fold-change cannot be inferred to a value better than 3 < R < 5. 

With decreasing signal-to-noise ratio, the distribution JrCR) not only broadens, but its 
peak shifts downwards. Thus, in FIG. 1 for the measurement pair (40, 10), the median of the 
distribution is about 2.2, with the actual maximum occurring very close to a value of 1. This 
broadening and shifting of the distribution function indicates that for weakening signals, the 
ratio of the measurements becomes an increasingly less reliable indication of the actual fold- 
change. Finally, in the limit of measured values both zero, (0, 0), the recovery of Equation 
(26) indicates that the distribution is very broad, with median R = 1 and a peak at R = 0. 

FIG. 2 qualitatively illustrates the behavior of the distribution^/?), which was 
previously quantified in FIG. 1, through utilization of the following construction: (i) for each 
pair of values (*„ x 2 ), draw a box in the plane about the point (jc„ x 2 ) with extents ± a E in each 



/.<«)- 



i i 



(28) 



n cosh(w) 
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dimension, excluding regions which fall along negative axes and (ii) then draw a set of lines 
from the origin to all points in the box. The distribution of the slopes of these lines represents 
the a posteriori distribution f R (R). 

4. Bayesian Estimation of Fold-Changes 

Bayesian estimation of the fold-change R can be performed based on Equation (16) and 
knowledge of the measurements x, and x 2 . Initially, the cumulative distribution function is 
defined: 



F(R) is preferably evaluated by use of numerical integration. Based upon the numerical values 
of F(R), the following information may be readily obtained. 

4.1 Fold-change estimator R: 

The median estimator was chosen as an estimator R for the fold-change: 



that is, the value of R for which F(R) = 1/2. 

Other estimators are possible, for instance the MAP (Maximum a posteriori 
Probability) or the mean estimators. See e.g., Van Trees, H. L., Detection, Estimation and 
Modulation Theory, Part I (John Wiley and Sons), New York, 1998). However, the mean 
estimator is not used here, as f R (R ) does not have a finite mean (i.e., it will always have a 
"tail" with dependence 1/i? 2 , even in the near-normal limit of Equation(21)). Thus, the median 
estimator has the dual advantages of robustness and symmetry under the transformation (R — ► 
l/R), and is the one which is adopted herein. Formally, the median estimator is one that 
reduces, e.g., minimizes, the absolute value of the (estimate-actual value) error term. See e.g., 
Van Trees, H. L., Detection, Estimation and Modulation Theory, Part I (John Wiley and 
Sons), New York, 1998). 

4.2 Confidence limits R p and R^: 

Given p < 1, the confidence limits R p and R,^, are defined as the values of the 
corresponding percentiles: 




(29) 



R = Med(R) 



(30) 



15 



WO 00/71756 



PCT/US00/14674 



F{R P ) 



(31) 



(32) 



4.3 P-value for significance of change: 

The hypothesis R > 1 ("a significant, positive fold-change occurred in experiment 2 
relative to 1") may be tested by evaluating the probability of the complementary hypothesis, 
R < 1 and defining this as the P-value P of the hypothesis for significant change. This is 
simply represented as: 



Results for all the measurement pairs discussed in connection with FIG. 1 are also illustrated 
in FIG. 4 below, with confidence limits determined by p = 0. 16. Note that having the P-value 
provides a powerful selection criterion for retaining only those measurement pairs deemed 
significant. Thus, while all ratios of the measurements shown in FIG. 4 are equal to 4 (except 
of course for (0, 0)), only the first three entries ((100, 400), (50, 200), (25, 100)) are found to 
indicate a significant change (i.e., at the 0.05 confidence level). In turn, for each of these 
aforementioned tabular entries, confidence limits for the fold-change are known. Thus, for the 
measurement pair (25, 100), the estimate of R = 3.6 is bracketed by the values (2.0, 8.8), 
showing that in this example the fold-change can not be ascertained more accurately than this 
reported interval (i.e., actual fold-changes as small as 2 and as large as 8.8 are consistent with 
the data). 

5. Mapping Intensity Pairs (x„ x 2 ) into the (if, F) Plane 

The pair of intensities (;c l9 x 2 ) are mapped by Equations (30) and (33) into pairs of 
numbers (R, P). This mapping, which provides a significance-weighted representation of the 
fold-changes, is illustrated in FIG. 3. For the sake of simplicity, a 1 = a 2 s a was chosen. 

FIG. 3 shows the lines of constant x 1 and constant x 2 in the (log(R), P) plane. The 
figure is symmetrical under the interchange R — > (l/R) (i.e., log(7?) -» -log(7?)), because the 
value a x = a 2 was chosen for this particular example. For a given R, the range of P is finite, 
with an upper bound P U (R) such that: 



P= F(R = l) . 



(33) 




(34) 
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Because P U (R) —> 0 as R -» oo or R — > 0, large fold-changes are necessarily correlated with 
small P-values, albeit always in a finite non-zero range. 

An expression for P U (R) is given by: (see Equation (65) in Appendix A for a derivation 
of the term P U (R) : 



where erfc is the complementary error function ((see Abramowitz, M. and Stegun, I. A., p. 297 
Handbook of Mathematical Functions (Dover, New York, 1972)), and with t m » 0.477. 
Equation(35) is strictly only asymptotically valid for R 0 1 or R M 1 , but in fact it provides an 
excellent approximation for all values of R, as can be seen in FIG. 3. 

For R > 1, the boundary P = P M (R) corresponds to the line x 1 = 0 in the (*„ x 2 ) 
plane (ie, the x 2 axis). The points on this boundary are the points for which a given 
fold-change R has the least significance (i.e., has the largest value of F). Lines of 
constant R correspond to arcs within the (x l9 x 2 ) plane, which all originate at the x 2 axis 
(for R >1), at which point P is a maximum, and which then asymptote to the line x 2 
=Rx u for which P rapidly tends to 0. 

6. Implementation - The PFOLD Algorithm 

The estimation scheme described hereinabove has been implemented in a C++ program 
called PFOLD. For a given set of input parameters (x l9 x 29 ct„ a 2 ), specifying the two 
intensities and the corresponding standard deviations of the noise terms, PFOLD first 
numerically evaluates the distribution function fr\(R) (see Equation (16)) over a finite range 
R min <R< R max at points on a regular mesh R ( = R min + iAR, i = 0, 1, ...N, where R min9 R^, and 
AR are automatically chosen to capture all of the variation of the function (FIG. 1). The 
cumulative distribution function F(R) (see Equation(29)) is then found by numerical 
integration of f R (R), following which all the estimators of Section 5 (i.e., the fold change R, the 
confidence limits (R p , R^), and the P-value P can be readily evaluated by numerically solving 
for Equations (30), (31), (32) and (33), respectively. In finding the roots of these 
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aforementioned equations, a simple bisection method was used. See e.g., Press, W., et al, 
Numerical Recipes in C, 2 nd Edition, p. 353 (Cambridge University Press, Cambridge, 1997). 

7. Monte Carlo Simulations 

A central problem in the analysis of expression data is separating significant from non- 
significant fold-change. In order to evaluate the usefulness of the statistics (R 9 P) in this 
process, a series of Monte Carlo simulations (see, e.g., Cowan, G., Statistical Data Analysis, p. 
41 (Claredon Press, Oxford, 1998) were preformed which were aimed to approximate an actual 
experiment. Concentration values n were generated according to a log-normal distribution 
(see e.g., Cowan, G., Statistical Data Analysis, p. 34 (Claredon Press, Oxford, 1998), by 
computing: 

w= expOO, ( 36 ) 
where y is a Gaussian random variable, generated with parameters: 

<y>= 725, (37) 

<7, = L22, (38) 

where <y> and a y , are the mean and standard deviation of>>, respectively. The parameters of 
Equations (37) and (38) result in a distribution with 25th percentile, median and 75th 
percentile with values: 

* 25 = 618, (39) 
* 50 = 1408, (40) 

« 75 = 3208, (41) 

respectively. The choice of a log-normal distribution for the concentration r\ is dictated by the 
empirical observation that in actual experiments, the distribution of intensities of present genes 
is approximately log-normal. For Affymetrix® chips, with an antibody staining procedure 
following hybridization, the intensities indicated by the percentiles in Equations (39), (40) and 
(41) are typical. 

For each value of r\ generated by Equation (36), a real fold-change of b, combined with 
noise, was simulated by computing the two intensity values: 
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x 1 = n + e x 



(42) 



x 2 = bn + e 2 



(43) 



where the noise terms 8! and e 2 are uncorrelated Gaussian random variables with means 
<£!> = < s 2 > = 0, and with standard deviations given by Equation (6) with the parameters: 



Finally, from the intensities (x u x 2 ) computed with Equations (42) and (43), the corresponding 
estimators (R 9 F) were computed using Equations (30) and (33). 

7.1 Class assignments: 

In order to ascertain the degree of definiteness, two sets of simulations were conducted, 
each of which defined a class of genes undergoing a given fold-change: 

Class 0: no change, b = 1. 

Class 1: change, 6 = 3. 

The effectiveness of using PFOLD to discriminate between the 2 classes of genes was 
evaluated to select genes which belong to Class 1 . In order to accomplish this evaluation, an 
acceptance region D within the (R, F) plane was defined (see e.g., Cowan, G., Statistical Data 
Analysis, p. 47 (Claredon Press, Oxford, 1998), as well as defining the prediction n for the 
class membership of a gene to be: 



cr c = 600, 



a = 0.25. 



(44) 



n - 



p if(R,P)eD x , (i.e. assign gene to class 1) 
a if{^R,P)€D x , (i.e. assign gene to class 0) 



(45) 



where p and a stand for present and assent in the acceptance region, respectively. An example 
of an acceptance region D is one with a rectangular-decision surface defined by: 




(46) 



however, more general regions will be considered as well. 



For any choice of D, it is possible to derive an estimate of the probabilities: 



P(p\Q) = probability that a gene in Class 0 gets assigned to Class 1, 
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P(a\0) = probability that a gene in Class 1 gets assigned to Class 0, 

by simply counting, in each case, the number of instances (R, P) which belong or, alternately, 
do not belong to D. If in turn, values are assumed for the a priori probabilities that, in a large 
set of genes, some will undergo no fold-change, and others a fold-change of 3 (for the sake of 
simplicity, it is assumed that no other fold-changes are possible outside of 1 or 3), 

P 0 = a priori probability that a gene is in class 0, 

Pj= a priori probability that a gene is in class 1 . 

Bayes' theorem may then be utilized to obtain the a posteriori probabilities: 

P(p\0) = probability that a gene assigned a significant fold-change did not really 

change, 

P(a\0) = probability that a gene assigned to the no-change category actually 

changed. 
The result is: 

P(0\p)=P o P(p\0)/P p , (47) 

P{\\a)=P x P{a\\)/P u . (48) 

where P p and P a , the total a posteriori probabilities of declaring a gene in Class 1 or Class 0, 
respectively, are given by: 

P^PiplO^ + il-PiaWP, , (49) 

P a = (\-P{p\Q))P 0 + P{a\\)P x . (50) 
The two quantities which are of greatest interest include: 

P(a\ 1 ) = absolute false negative rate, (51) 

P(0\p) = relative false positive rate. (52) 

The definitions of Equations (51) and (52) are not symmetrical because the calculation of 
P(0\p) requires the value of the prior P l9 whereas the computation of P(a\l) does not. The 
absolute false negative rate is a measure of the fraction of all expressed genes that will be 
missed by the detection scheme at a given stringency. The relative false positive rate, on the 
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other hand, refers to the fraction of the detected genes that is misclassified, and which did not 
in fact undergo a change. Therefore, the false negative rate, as defined herein, is thus a 
measure of the efficiency (see e.g., Cowan, G., Statistical Data Analysis, p. 47 (Claredon 
Press, Oxford, 1998), or sensitivity of the detection scheme (i.e., the smaller value is 
preferred), while the false positive rate is a measure of the purity (see e.g., Cowan, G., 
Statistical Data Analysis, p. 47 (Claredon Press, Oxford, 1998) or selectivity of the scheme 
(i.e., the smaller value is preferred). 

7.2 Results of experimental simulation: 

In FIG. 6 (Panels A and B), there is a comparison of scatter plots within the (R 9 P) 
plane generated by 1000 genes from Class 0 (the no-change class) and 1000 genes in Class 1 
(the genes which exhibited a 3-fold change), respectively. In order to facilitate understanding 
of this concept, the following equations are based upon a scenario with an a priori probability 
of a gene changing of: 



This defines a configuration with 1000 genes changing 3 -fold, against a background of 4000 
unchanging genes. 

A method of choice for displaying the dependence of error rates on the position of a 
decision surface is the construction, in graphical format, of the so-called receiver operating 
characteristic (ROC) of the decision scheme. See e.g., Van Trees, H. L., Detection, Estimation 
and Modulation Theory, Part I (John Wiley and Sons), New York, 1998). The ROC enables 
one to clearly visualize the tradeoff between reducing, e.g., minimizing, false positive rates, 
thereby increasing the selectivity of the scheme, and reducing, e.g., minimizing, false negative 
rates, thereby also increasing the overall sensitivity of the given scheme. 

In FIG. 7, the receiver operating characteristic (ROC) are plotted which are obtained 
when one use as statistic for a decision boundary the fold-change itself, t = R. Thus, in the 
previous case, the acceptance region is defined simply as: 



so that the decision surface is a vertical line within the (i?, P) plane. In FIG. 7, the false 
positive rate P(0\p) and the false negative rate P(a\l) are plotted as a function of R c . It can be 



P t = 0.2. 



(53) 




(54) 
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seen that as the stringency of the test for acceptance is increased (i.e., increasing R c ) 9 the 
relative false-positive rate decreases (i.e., the purity of the detected sample increases), but that 
there is also a concomitant increase in the absolute false negative rate as well. In addition, 
FIG. 8 illustrates the receiver operating characteristic (ROC) which is obtained for the statistic 
t = -P. 

FIG. 5 illustrates in tabular form the performance of the three statistical methodologies 
utilized for the detection of 1000 genes with actual fold-change of b = 3, against a background 
of 4000 genes with no fold-change of b = 1, based upon the Monte Carlo experimental 
simulations described in Section. 7 (i.e., the a priori probability of a gene undergoing the 3- 
fold change is 

P x = 0.2). Specific results are reported for a fixed false positive rate P(0\p) = 0.3. FIG. 9 
illustrates the compared sensitivity as a function of P x = fraction of genes which underwent a 
change (b = 3), for the R and P statistics. A fixed relative false positive rate P(0 1 p) = 0.3 is 
imposed throughout. 

The results illustrated in FIG. 5 and FIG. 7 show that the use of the P-value (t = -f 
statistic) instead of, or in conjunction with, the fold-change R, can markedly increase the 
sensitivity of the various ranges of parameters which were, heretofore, extremely hard to 
detect. 

In conclusion, due to the low signal-to-noise ratio which is inherent in expression data, 
this noise must be carefully accounted for. The PFOLD algorithm disclosed herein offers a 
theoretical and practical framework for dealing with noise. For example, the PFOLD 
algorithm allows for two important metrics for fold-change of the level of gene expression: (/) 
the P-value, which reflects the overall "quality" of the ratio; and (ii) R, which reflects the 
"quantity" of the fold-change in the expression of the gene(s). In addition, the PFOLD p- 
statistic is essential for quantifying small populations of changing genes and/or small fold- 
changes of the expression level of such genes. 

Appendix A: Distribution for x x = 0 

For a given fold-change R > 1, the least significant predictions arise from an intensity 
pair with x x = 0. To investigate this dependency, the approximate form of Equation (16) is 
generated when x x = 0, and x 2 » o l 2 . The result is: 
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1/2 



By 



n) (b 2 + a\ I alf 2 {' 2(b> + *1 / *?)) ' 



y 



(55) 



where v = ;c 2 /o-, . With the transformation: 



u = 



1/2 > 



(56) 



the interval 0 < B < oo is mapped into 0 < u < a,/a 2 , and the distribution for u is given by: 



/.(-)- (7) 



1/2 



.yexp(-j>V/2) 



(57) 



(58) 



It is easy to check that the correct normalization of the distribution function obtains, since: 

The approximation in Equation (58) holds because = x 2 /a t » 1. 
To compute the P-value for a given value ofy: 

P=P(i?<l)=p(w>M 1 ) , 
where: 

^(l+a*/^)" . (60) 

Using Equation (57), and integrating over the range u x < u < oo, it is found that: 



(59) 



(61) 



To compute the predicted fold change B for a given value of y, the definition of B as the 
median of the distribution is utilized: 



\= P(B< B)=P(u>) . 



(62) 



This results in the equation: 



\=erf[4n{R 2 + <rll°l) 



1/2 



(63) 
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from which we find the relation between .y and R: 



\l/2 



(64) 



where / M * 0.477 is the root of the equation erf(f M ) = 1/2. Using Equation (64), y can be 
eliminated from Equation (61), obtaining the final equation: 



erfc 



erfc 



(k 2 + a 2 2 /cxl) 



, R>1, 



1/2 \ 



(65) 



, *>1, 



where r M » 0.477. 



Referring to FIG. 1 1, a process 150 for calculating differences in the level of gene 
expression in at least one array of genes is shown. The process 150 uses a mathematical 
formula to describe an a posteriori statistical distribution of the levels (e.g., all the levels) of 
gene expression that may be derived from the measurements obtained of levels of gene 
expression in one or more cells or tissue types represented in the at least one array. 

At stage 152, an experimental noise associated with intensity of hybridization signal 
for each gene in the at least one array is defined. This noise is experimental noise, being 
variations in observed levels on chips or other microarrays rather than biological noise, which 
is the variation of expression level seen in biological systems. 

At stage 154, the defined experimental noise is used to define an analytical probability 
distribution function (pdf) describing distribution values of intensity for each gene. The noise 
is assumed to be Gaussian and the analytical pdf is defined using Bayes Theorem. The 
analytic pdf is a continuous function. 

At stage 156, the analytic pdfs are used to derive an analytical joint pdf describing 
possible ratios or fold changes for differentially-expressed genes or gene products in the at 
least one array. The analytical joint pdf describing possible ratios or fold changes may be 
derived for any differentially-expressed genes or gene products. 

At stage 158, the joint pdfs are applied, using experimentally-derived intensities and 
noise values from the genes on the at least one array, to determine values related to fold 
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changes associated with the genes. The fold changes in the concentration of gene transcripts 
are estimated. The confidence limits on the fold change given specific confidence intervals arc 
established. A p-value, or quality metric associated with the fold change estimate is also 
derived. This value represents the probability that a fold change could be less than 1 when the 
estimate is greater than 1, or the probability that the fold change is greater than 1 when the 
estimate is less than 1 . 

The estimated fold change represents the difference in level of gene expression 
observed. The total variance (noise) may still be high even as the concentration of transcript 
goes to zero. 

Equivalents 

From the foregoing detailed description of the specific embodiments of the invention, a 
unique mathematically-derived a posteriori distribution for the estimation of alterations in 
gene expression has been described. Although particular embodiments have been disclosed 
herein in detail, this has been done by way of example for purposes of illustration only, and is 
not intended to be limiting with respect to the scope of the appended claims which follow. In 
particular, it is contemplated that various substitutions, alterations, and modifications will 
become apparent to those skilled within the art from the foregoing description and 
accompanying figures and may be made to the invention without departing from the spirit and 
scope of the invention as defined by the claims. Such modifications are intended to fall within 
the scope of the appended claims. 

Also, due to the nature of software, functions described above can be implemented 
using software, hardware, firmware, hardwiring, or combinations of any of these. Items 
implementing functions may also be physically located at various positions, including being 
distributed such that portions of functions are implemented at different physical locations. 
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1- A method for calculating differences in the level of gene expression in at least one 
array of genes comprising: 

(a) defining experimental noise associated with intensity of hybridization signal for each 
gene in the at least one array; 

(b) using the defined experimental noise to define an analytical probability distribution 
function describing distribution values of intensity for each gene; 

(c) using the analytic probability distribution functions to derive an analytical joint 
probability distribution function describing at least one of a possible ratio and a fold 
change for at least one differentially-expressed gene or differentially-expressed gene 
product in the at least one array; 

(d) applying the joint probability distribution function of each differentially-expressed 
gene and gene product using experimentally-derived intensities and noise values from 
the genes on the at least one array to determine values related to fold changes of the 
genes. 

2. The method of claim 1 wherein the determined values include estimated fold changes 
in the concentration of gene transcripts. 

3. The method of claim 2 wherein the determined values include a quality metric 
associated with at least one of the estimated fold changes. 

4. The method of claim 3 wherein the quality metric represents at least one of a 
probability that a fold change could be less than 1 when an estimated fold change is 
greater than 1, and a probability that a fold change is greater than 1 when the estimated 
fold change is less than 1. 
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5. The method of claim 1 wherein the determined values include confidence limits on the 
fold change given specific confidence intervals. 



The method of claim 1 wherein the analytic probability distribution function is defined 
assuming that the noise is Gaussian and by applying Bayes Theorem. 

The method of claim 6 wherein the analytic probability distribution function is a 
continuous function. 



8. A computer program product, for calculating differences in the level of gene expression 
in at least one array of genes, residing on a computer-readable medium and comprising 
instructions for causing a computer to: 

(a) define experimental noise associated with intensity of hybridization signal for each 
gene in the at least one array; 

(b) use the defined experimental noise to define an analytical probability distribution 
function describing distribution values of intensity for each gene; 

(c) use the analytic probability distribution functions to derive an analytical joint 
probability distribution function describing at least one of a possible ratio and a fold 
change for at least one of at least one differentially-expressed gene or differentially- 
expressed gene product in the at least one array; 

(d) apply the joint probability distribution function of each differentially-expressed gene 
and gene product using experimentally-derived intensities and noise values from the 
genes on the at least one array to determine values related to fold changes of the genes. 

9. The computer program product of claim 8 wherein the determined values include 
estimated fold changes in the concentration of gene transcripts. 
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1 0. The computer program product of claim 9 wherein the determined values include a 
quality metric associated with at least one of the estimated fold changes. 



1 1 . The computer program product of claim 1 0 wherein the quality metric represents at 

least one of a probability that a fold change could be less than 1 when an estimated fold 
change is greater than 1, and a probability that a fold change is greater than 1 when the 
estimated fold change is less than 1 . 



12. The computer program product of claim 8 wherein the determined values include 
confidence limits on the fold change given specific confidence intervals. 

13. The computer program product of claim 8 wherein the instructions for causing a 
computer to define the analytic probability distribution function are based on an 
assumption that the noise is Gaussian and include instructions for causing the computer 
to apply Bayes Theorem. 



14. The computer program product of claim 13 wherein the analytic probability 
distribution function is a continuous function. 
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